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(54) Combining data analysis algorithms with databases on the Internet 



(57) An open architecture for arbitrarily combining data analysis algorithms and databases on the Internet 
where the data analysis algorithm and database may be from different vendors or suppliers. Customer 10 
selects an algorithm 55 from an algorithm supplier 50, and a database 70 from a database supplier 60. The 
data analysis algorithm 55 is securely relocated to the database supplier 60 and run on the appropriate 
database using an applet execution environment 75, which enables multi threaded processes constrained to 
communicate only with the selected database application (fig. 5). As the algorithm 55 runs, partial results are 
transmitted back to the customer 10 and displayed on the browser 20, so that the customer can decide 
whether to continue running the algorithm. An electronic commerce system 40 such as SET (Secure Electronic 
Transaction) may be used for charging for the services and content, and a suitable payment mechanism is 
described (fig. 6). 
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allowing users to dynamically combine service providers, e.g. f of data 
analysis algorithms with independent content suppliers, e.g., of 
databases. There is also a need for the system to maintain proper 
security for the proprietary algorithms and databases, and a pricing 
mechanism whereby the customer is charged for access to the algorithms 
and databases. The present invention addresses such a need. 

An electronic commerce model. Secure Electronic Transaction (SET) , 
has been proposed by major credit and computer vendors including IBM, 
Microsoft, VISA and Mastercard. This model will be supported by many 
entities engaging in commerce on the Internet. For example, IBM's 
merchant server "Net . Commerce" and cyber shopping district "World Avenue" 
have announced plans to use SET. See URL http://www.visa.com for more 
details on SET. 

The present invention is directed to an open architecture for 
securely combining data analysis algorithms and databases on the Internet 
where the data analysis algorithm and database may be from different 
vendors or suppliers. 

According to one aspect of the present invention, a computerized 
method for providing services over a communication network, comprises the 
steps of: sending a service provider on the network a message including 
an identifier of a user selected independent content provider and an 
identifier of a particular service associated with the service provider; 
in response to the message, sending from the service provider to the 
content provider, a computer executable code which when executed by the 
content provider will cause the particular service to be performed 
against content controlled by the content provider; executing the 
computer executable code by the content provider; and, returning at least 
partial results of said executing step to the user by way of the 
communication network. 

Preferably the computer executable code specifies one or more 
computing resources required, which include one of memory, disk, and CPU 
time, for rendering the particular service. 

Preferably the content provider specifies one or more computing 
resources available, which may include the memory or disk available for 
rendering the particular service. 
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Figure 4 shows a combined computer system and logic flow in 
accordance with the present invention; 

Figure 5 shows a more detailed example of the execution environment 
of Figure 2, in accordance with the present invention for securely 
executing the data analysis algorithm at the database supplier; and, 

Figure 6 depicts a logic flow diagram for the payment mechanism of 
Figure 2 . 

Figure 2 depicts a system having features of the present invention 
for arbitrarily combining computer services such as a data analysis 
algorithm 55, which may be provided by a data analysis algorithm 
supplier 50, with a database 70 which is provided by a database supplier 
60. Here, a customer (also called a user) 10 uses a client running a 
browser 20 to access servers 50, 60 via the Internet 3 0 and the TCP/IP 
suite of network protocols. Network protocols provide standard methods 
for machines to communicate with one another. The protocols indicate how 
data should be formatted for receipt and transmission across networks. 
Heterogeneous machines can communicate seamlessly over a network via 
standard protocols. Examples of standard Internet protocols include: 
HTTP, see, e.g., "Hypertext Transfer Protocol - HTTP/1.0", 
http: //www. ics .uci .edu/pub/ietf /http/draf tietf http-vl0-spec-03 .html, by 
T. Berners-Lee, R. Fielding, and H. Frystyk, Sept. 4,1995; SMTP, 
see, eg Simple Mail Transfer Protocol. RFC 821, J. B. Postel, Information 
Sciences Institute USC, August 1982, 

http://ds.internic.net/std/stdlO.txt.; and, FTP, see e.g., J. Postel and 
J. K. Reynolds. "File Transfer Protocol (FTP)", RFC 959, Information 
Sciences Institute, USC, October 

1985, http://ds.internic.net/std/std9.txt. The client-server model 
constitutes one of the dominant paradigms in network programming, see, 
e.g., W. R. Stevens, "Unix Network Programming", Prentice Hall PTR, 
Englewood Cliffs, NJ,1990; and D. E. Comer, "Internetworking with TCP/IP" 
vol 1., Prentice Hall, Englewood Cliffs, NJ,1991 which is hereby 
incorporated by reference in its entirety. A server program 40, 50, 60 
offers a service which can be accessed by multiple users over the 
network. A program becomes a client 20 when it sends a message to a 
server and waits for a response from the server 40, 50, 60. The client 
process, which is typically optimized for user interaction, uses the 
requested service without having to know any of the detailed workings of 
the requested service or server. On the World Wide Web "browsers" 
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aforementioned co-pending patent application by Chess. 

Figure 3 depicts a logic flowchart of the interactions within the 
computer system shown in Figure 2. A browser 20 is used to surf the Web 
and display information for the customer 10. As depicted, in step 500, 
the customer 10 locates the appropriate database 70. In step 510, the 
customer 10 selects a specific data-analysis algorithm. This may involve 
a web search or the customers 10 may already have the URL of the 
algorithm supplier 50 and/or database supplier 60. The algorithm supplier 
50 may provide the minimum resource requirements (memory, disk, time) as a 
function of database size for the selected algorithm. The supplier may 
optionally provide a function that gives a time estimate for resources 
(memory, disk) greater than the minimum. The database supplier 60 may 
similarly specify the resources (memory, disk) available for Internet 
data-analysis and/or the size of the relevant database. In step 520, the 
customer 10 passes the algorithm name and URL of algorithm supplier 50 to 
the database supplier 60. The customer 10 may optionally specify that 
additional resources (memory, disk) be used rather than the minimum. The 
DB supplier 60 locates algorithm supplier 50 and downloads the 
appropriate data analysis algorithm. In a preferred embodiment, 
(described with reference to Figures 4 and 5) the data analysis algorithm 
is a downloadable code fragment such as a Java applet. Each downloadable 
code fragment is preferably verified to ensure that it conforms to the 
underlying execution environment 75. Alternatively, if the algorithm 
supplier 50 is trusted by the DB supplier 60, a binary of the algorithm 
may be downloaded to the DB supplier 60. In step 530, the downloadable 
code fragment 80 is then run at the execution environment at the database 
supplier 60. In step 550, the execution environment 75 enables multi 
threaded processes which can be constrained to communicate only with the 
selected database application. A thread in the database execution 
environment 75 may be used to support each customer 10 transaction. In 
step 540, the Database supplier 60 returns at least partial results to 
the customer 10. The customer 10 may be charged (discussed later with 
reference to Figure 6) for each round of partial results. In a preferred 
embodiment, an electronic commerce model 4 0 such as SET is adopted to 
charge customers 10 and credit the database and data analysis algorithm 
suppliers 50, 60. In step 57 0, if the customer wants to continue, the 
process repeats at step 530. Otherwise, in step 560, the process ends. 

Figure 4 shows an example of a . combined computer system and logic 
flow in accordance with the present invention. In this embodiment, the 
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execution environment 75 comprises a Java virtual machine (described in 
more detail with reference to Figure 5) and the downloadable code 
fragment is a Java applet. Java is a well known computer programing 
language, developed by Sun Microsystems, for the Internet. See, for 
example. "The Java Handbook," by Patrick Naughton, Osborne McGraw-Hill 
(1996). See also URL http://www.javasoft.com/java.sun.com/source.html As 
depicted, pairs of components that interact- are connected by directional 
lanes II through 17 (uni-directional or bi-directional) indicating flow 
of data or control. There are seven interactions that take place between 
the vanous participants as enumerated below: 



1- The customer 10 selects a specific data-analysis algorithm. This 
*ay evolve a web search or the customers 10 may already have the URL of 
the algorithm supplier 50. The algorithm supplier 50 provides the minimum 
resource retirements (memory, disk, time) as a function of database size 
for the selected algorithm. The supplier may optionally provide a 
function that gives a time estimate for resources (memory, disk) greater 
than the minimum. A browser 20 is used to display the information for the 
customer 10. 

2 



30 



The customer 10 locates the appropriate database. The customer can 
Perform a web search or the customer may already have the URL for a 
database supplier 60. The database supplier 60 may also specify, the 
resources (memory, disk) available for Internet data-analysis and the 

size of the relevant database. 

3- The customer 10 passes the algorithm name and URL of algorithm 
supplier 50 to the database supplier 60. The customer 10 may optionally 
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5. 



6. 



The DB supplier 60 locates algorithm supplier 50. 

The DB supplier 60 downloads the appropriate applet 80. 
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reference, describes a mechanism for applets to access system resources 
in a controlled manner. This mechanism allows a Java Applet to access 
parts of the file system other than those specified statically using the 
CLASS PATH variable and allows applets to communicate with servers other 
than the one that the applet was downloaded from- This second 
verification step requires the use of the technology described in Anand 
et al . In this case, the present invention may stamp each applet with 
security and resource credentials that specify where the applet came from 
and what resources the applet will use. If the origins of the applet are 
trusted then so are the resource constraints. Java provides that the 
downloaded applet can either be compiled to run on the native machine's 
code or it may be interpreted. If the algorithm supplier 50 is trusted by 
the DB supplier 60, it can ship a binary of the algorithm to the DB 
supplier 60. The applet 80 is then run on the database supplier 60. 

Java also provides a multi threaded programming paradigm. See, 
e.g., Naughton, pp. 181-199. The applet is preferably constrained to run 
so that it cannot communicate with applications besides the database. A 
system thread 100 in the database applet system may be used to support 
each customer 10 transaction. 

7. The DB supplier 60 returns results (potentially partial results) to 
the customer 10. A pricing mechanism (discussed later) may be used to 
charge the customer 10 for each round of partial results. 

Preferably, an electronic commerce model 40, such as SET, is 
adopted to charge customers 10 and credit the database and data analysis 
algorithm suppliers 50, 60. 

Those skilled in the art will appreciate that the interactions can 
easily be changed so that customers 10 interact with the algorithm 
supplier 50 solely except to select the DB supplier 60. In this case, 
interaction 3 above is changed so that the customer 10 passes the 
database name and URL of the database supplier 60 to the algorithm 
supplier 50. Interaction 4 is changed so that the algorithm supplier 50 
locates the database supplier 60. Also, interaction 5 may be changed so 
that the algorithm supplier 50 uploads the applet 80 to the database 
supplier 60. 

The only essential dependencies in the interactions above are as 
follows: Interactions 1 and 2 occur in any order but must occur before 



interaction 3. Interactions 3, 4, 5, 6, and 7 occur in that order. 
Interaction 7 may occur multiple times as partial results are returned to 
the customer 10 and the customer 10 is charged for the algorithm usage, 
database access, and partial results returned. 



Note that one or more of the logical participants given above may 
map to a single physical participant. 

Those skilled in the art will also appreciate that this 
architecture is recursive in the following sense. The database supplier 
60 may actually obtain its data by being the customer 10 that buys data 
analysis services over the Internet. Conversely, the customer 10 in 
Figure 4 may turn around and be the database supplier 60 for another data 
analysis transaction with another group of participants. In other words, 
a participant that is a customer 10 in one transaction may be a supplier 
in another transaction. 



A broker can also be added to act as an intermediary between the 
customer 10 and the other parties. The customer 10 interacts with the 
broker alone as a one-stop supplier. The broker interacts with the 
algorithm supplier 50 and database supplier 60 as described above (as if 
the broker were the customer 10 in Figure 4) . 

The following protocols can be used to implement the interactions 
in Figure 4. Interactions II, 12, 13, and 17 may be implemented by using 
the HTTP protocol. Interactions 14 and 15 may be implemented using the 
Java downloading protocol. All interactions with the electronic commerce 
system maybe implemented using the SET 

(seehttp: / /www. visa. com/ cgi-bin/vee/sf /set/ intro .html?2 + 0) protocol. 

In our preferred embodiment the customer (user) 10 has access to 
the Netscape browser. At the customers request, the browser obtains a 
list of databases, data analysis algorithms and their suppliers from the 
Web via a standard search engine such as Yahoo!. As is conventional, the 
customer chooses a database 70 and a data analysis algorithm 55 by 
clicking on the appropriate images which are displayed on the browser 
using HTML . 



The customer may input a maximum amount of money he would like to 
spend initially. Then the customer clicks the go button (representing a 
conventional hyperlink) to initiate the transaction. A request is sent to 



the database supplier 60 in the form of an http request. As is 
conventional, the database supplier has a http daemon (httpd) running 
that is Java enabled (see, e.g., Naughton, pp. 244-249). 

Figure 5 shows a more detailed example of an execution environment 
75 in accordance with the present invention for securely executing the 
data analysis algorithm at the database supplier. As depicted, the 
database supplier's http daemon communicates with the data analysis 
algorithm supplier through the Java language to download 520' the applet, 
using Java's internal protocol for downloading applets. The results are 
returned 540' to the customer using http and displayed using html. In our 
preferred embodiment we assume that the database supplier has the Java 
execution environment 210 running and that the Java on the database 
supplier is JDBC enabled 530'. JDBC is a well known and evolving Java 
application programming interface (API) to SQL databases. It is being 
developed by the JavaSoft division of Sun Microsystems. See URL 
http://splash.javasoft.com/jdbc/ for more details on JDBC. The JDBC 
library calls the database 13 0 using SQL. An exemplary database and 
database management system is that sold by IBM under the trademark "062". 

The algorithm supplier 50 provides data analysis algorithms written 
as Java applets. The applets reside at . the data analysis algorithm server 
50. The chosen applet is downloaded to the database supplier and run. 

Preferably, the applet runs in a thread which is constrained not to 
communicate outside the server it is running on. Java also provides a 
pool of system threads 100 that are constantly running (see' 
http://www.javasoft.com/java.sun.rom/source.html). According to one 
aspect of the present invention, a system thread 100 may be used to 
co-ordinate iterations with the customer 10'. When the Java applet 
containing the data analysis algorithm is downloaded, it registers itself 
with one of threads in the system thread pool. The downloaded applet 
communicates with the system thread 100 which in turn communicates 540' 
with the customer. These threads act as proxies which is similar to how 
the JAVA window system, Active Window Toolkit (AWT), is structured. 

The system thread 100 communicates partial results to the customer, 
and determines whether or not the algorithm should continue executing 
after providing partial results to the customer. Thus, it may terminate 
the execution of the data analysis algorithm at any time. As is 
conventional, the data analysis algorithm may not write to local file 
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+ price_of_resources used 

+ price-of -data-sent-to-customer 

Different data in the database as well as different databases may- 
have different prices associated with them. The price of data sent to the 
customer 10 may be a suitably large flat amount per bit. If the customer 
10 supplies the data-analysis algorithm and tries to send back the entire 
database to the customer 10, the cost per bit approach acts as an 
inhibitor to such activity unless of course the customer 10 really wants 
the entire database. By charging appropriate prices, the DB supplier 60 
can provide sufficient incentive for customers 10 to do data-analysis on 
the DB supplier 60 computer and collect some valuable summarized result 
as opposed to copying the entire database. 

Figure 6 depicts a logic flow chart for the payment mechanism of 
Figure 2. The SET protocol or some other electronic commerce protocol may 
be used for the payment transactions. Before the data analysis algorithm 
is run at the database supplier, an initial amount Y is charged to the 
customer's account and the same amount is credited to the database 
supplier in step 600. After the data analysis algorithm has been run (to 
partial completion) so that the combined amount to be credited the 
database and algorithm suppliers is less than or equal to Y, partial 
results are returned to the customer and the database supplier computes 
the exact amounts XI and X2 to be credited to the algorithm and database 
suppliers respectively in step 610. The database supplier pays the 
algorithm supplier the amount XI in step 620. In step 63 0, the database 
supplier returns Y minus (XI + X2 ) , the excess amount to the customer. In 
step 640, the database supplier finds out from the customer whether he or 
she wants to continue further with the data analysis algorithm execution. 
If yes, the previous steps are repeated. Otherwise, the payment 
transactions are done. 

The roles of AS and DS are reversible in the payment transactions. 
If the roles are reversed, the DS must still compute the cost function in 
step 610 but the AS will return the results to the customer 10. As an 
optimization, the refunds may be returned to the customer 10 in one 
action rather than at the end of each iteration. 

The Algorithm supplier 50 typically trusts the DB supplier 60 as 
does the customer 10. The DB supplier 60 does not typically trust anyone. 
However, under special arrangements, the DB supplier 60 may trust an 
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Server Any computer that performs a task at the command of another 
computer is a server. A Web server typically supports one or more 
clients . 

World Wide Web (WWW or Web) The Internet's application that lets 
people seeking information on the Internet switch from server to server 
and database to database by clicking on highlighted words or phrases of 
interest (hyperlinks) . An Internet WWW server supports clients and 
provides information. The Web can be considered as the Internet with all 
of the resources addressed as URLs and which uses HTML to display the 
information corresponding to URLs and provide a point -and-click interface 
to other URLs . 

Universal Resource Locator (URL) A way to uniquely identify or 
address information on the Internet. Can be considered to be a Web 
document version of an e-mail address. They can be accessed with a 
Hyperlink. An example of a URL is "http : //www . arun . com: 80/ table .html " . A 
URL has four components. Starting from the left, the first specifies the 
protocol to use, separated from the rest of the locator by a M : " . Next is 
the hostname or IP address of the target host; this is delimited by the 
■//" on the left and on the right by a ■/" or optionally a The port 

number is optional, and is delimited on the left from the hostname by a 
":" and on the right by a "/". The fourth component is the actual file 
name or program name. In this example, the ".html" extension means that 
this is an HTML file. 

HyperText Markup Language (HTML) HTML is the language used by Web 
servers to create and connect documents that are viewed by Web clients. 
HTML uses Hypertext documents. Other uses of Hypertext documents are 
described in U.S. Patents 5,204,947, granted April 20, 1993 to Bernstein 
et al.; 5 ,297,249, granted March 22,1994 to Bernstein et al . ; 5,355,472, 
granted October 11,1994 to Lewis; all of which are assigned to 
International Business Machines Corporation, and which are incorporated 
by reference herein. 

Hypertext transfer protocol (HTTP) HTTP is an example of a 
stateless protocol, which means that every request from a client to a 
server is treated independently. The server has no record of previous 
connections. At the beginning of a URL, "http:" indicates the file 
contains hyperlinks- 
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Internet Browser or Web browser A graphical interface tool that 
runs Internet protocols such as http. and displays results on the 
customers screen. The browser can act as an Internet tour guide, 
complete, with pictorial desktops, directories and search tools used when 
a user "surfs- the Internet. In this application the Web browser is a 
client service which communicates with the World Wide Web. 

HTTP Daemon (HTTPD) A server having Hypertext Markup Language and 
Coimnon Gateway Interface capability. The HTTPD is typically supported by 
an access agent which provides the hardware connections to machines on 
the intranet and access to the Internet, such as TCP/IP couplings. 

Applet Downloadable code fragment. 

Applet system System that can securely download code and execute 

it . 
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Java A computer programming language developed by Sun Microsystems 
for programming on the Internet. 

Secure Electronic ansaction (SET) protocol A protocol for doing 
secure electronic transactions on the Internet to purchase goods or 

services using credit cards. 

Data Analysis Algorithm A computer process that analy Z es data to 
infer properties of the data. 

Database A repository of data or information. 
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1. A computerized method for providing services over a communication 
network, comprising the steps of: 

sending a service provider on the network a message including an 
identifier of a user selected independent content provider and an 
identifier of a particular service associated with the service provider; 

in response to the message, sending from the service provider to 
the content provider, a computer executable code which when executed by 
the content provider will cause the particular service to be performed 
against content controlled by the content provider; 

executing the computer executable code by the content provider and 

returning at least partial results of said executing step to the 
user by way of the communication network. 

2. The method of Claim 1 wherein the computer executable code 
specifies one or more computing resources required, which include one of 
memory, disk, and CPU time, for rendering the particular service. 

3 . The method of Claim 1 wherein the computer executable code 

specifies one or more computing resources available, which include one of 
memory, and disk, for rendering the particular service. 

4. The method of Claim 1, further comprising the steps of : 

selecting by a user, the service provider and the particular 
service: and, 

selecting by a user, the content provider. 

5. The method of Claim 4, further comprising the steps of : 

in response to said selecting step, the user communicating the 
message to the content provider; wherein said step of sending a service 
provider on the network a message is performed by the content provider, 
in response to the message communicated from the client. 
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provider and the particular service is a data analysis algorithm, the 
computer executable code is an applet which when executed by the content 
provider will cause a query to be performed against the database 
controlled by the database provider; and when executing the applet by the 
database provider, the applet is constrained to restrict communication to 
an application associated with the database. 

15. The method of claim 14, further comprising the step of billing the 
user based on one or more of the particular data analysis algorithm, 
database, a computing resource used, and the at least partial results, in 
response to said returning step; wherein the data analysis service 
provider, database provider, and the user are communicating with Java 
enabled machines . 

16- A computer system for providing services over a communication 
network including a plurality of servers, the system comprising: 

a client coupled to the network and adapted for communicating 
requests from a user; 

the client and the servers including a communication mechanism for 
sending a service provider on the network a message including an 
identifier of the user selected independent content provider and an 
identifier of a particular service associated with the service provider; 

the servers including a downloading mechanism for sending from the 
service provider to the. content provider, a computer executable code 
which when executed by the content provider will cause the particular 
service to be performed against content controlled by the content 
provider, in response to the message; 

an execution mechanism, coupled to the downloading mechanism, for 
executing the computer executable code by the content provider and, 
means for returning at least partial results of said executing step to 
the user by way of the communication network. 

17. The system of claim 16, further comprising: 

the client being adapted for communicating the message to the 
service provider and the service provider being adapted for sending the 
computer executable code in response to the message communicated from the 
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18. The system of claim 16. further comprising an electronic 
system, coupled to the network, for interactively billing the user based 
on the at least partial results. 

19. The system of claim 18 further comprising a computerized payment 
means, coupled to the database supplier for determining a cost to the 
user for the at least partial results. 

20. The system of claim 16 wherein the communications network includes 
the World Wide Web (WWW) , wherein the service provider is a data analysis 
service provider, the independent content provider is a database provider 
and the services is a data analysis algorithm; the executable code is a 
downloadable code fragment which when executed by the content provider 
will cause a query to be performed against a database controlled by the 
database provider; 

said execution mechanism executes the downloadable code fragment 
against the database while constraining communications to an application 

associated with the database. 

21. • The system of claim 20, wherein the service provider, the database 
Provider, and the client are communicating with Java enabled machines and 
wherein the downloadable code fragment is an applet. 

22. The system of claim 21, wherein the execution environment at the 
database provider further comprises: 

a multithreading mechanism; and 

a shared memory wherein the applet runs in a thread which is 
constrained to communicate only through the shared memory. 

" . ^ SyStem ° f Claim 21 < whe "- th. means for returning at least 

partial results of said executing step to the user by way of the 
communication network comprises a system thread, coupled to the applet, 
the system thread being adapted for communicating the partial results to 

the Client. 
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The system of claim 21 wherein the means for returning at least 
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partial results of said executing step to the user by way of the 
communication network comprises a content delivery mechanism, coupled to 
the applet, for communicating the partial results to the client. 
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